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ABSTRACT 

Lyman alpha ( Lya ) emission lines should be attenuated in a neutral intergalactic medium (IGM). 
Therefore the visibility of Lya emitters at high redshifts can serve as a valuable probe of reionization 
at about the 50% level. We present an imaging search for z = 7.7 Lya emitting galaxies using 
an ultra-narrowband filter (filter width=9A) on the NEWFIRM imager at the Kitt Peak National 
Observatory. We found four candidate Lya emitters in a survey volume of 1.4 x lO^Mpc^, with 
a line flux brighter than 6 x 10~^^ ergcm"^ s~^ (5cr in 2'' aperture). We also performed a detailed 
Monte-Carlo simulation incorporating the instrumental effects to estimate the expected number of 
Lya emitters in our survey, and found that we should expect to detect one Lya emitter, assuming 
a non-evolving Lya luminosity function (LF) between z=6.5 and z=7.7. Even if one of the present 
candidates is spectroscopically confirmed as a z 8 Lya emitter, it would indicate that there is no 
significant evolution of the Lya LF from z = 3.1toz~8. While firm conclusions would need both 
spectroscopic confirmations and larger surveys to boost the number counts of galaxies, we successfully 
demonstrate the feasibility of sensitive near-infrared (1.06/im) narrow-band searches using custom 
filters designed to avoid the OH emission lines that make up most of the sky background. 
Subject headings: galaxies: high-redshift — galaxies: Lyman alpha emitters — galaxy: luminosity 
function 



1. INTRODUCTION 

Lyman alpha ( Lya ) emitting galaxies offer a power- 
ful probe of both galaxy evolution and the reionization 
history of the universe. Lya emission can be used as a 
prominent signpost for young galaxies whose continuum 
emission may be below usual detection thresholds. It is 
also a tool to study their star formation activity, and a 
handle for spectroscopic followup. 

The intergalactic medium (IGM) will obscure Lya 
emissi on from view if the neutral fraction exceeds ~ 
50% (IFurlanetto et al.l 120061 : iMcOuinn etld]l2007[ ). Re- 
cently, Lya emitters have been u sed to show that the 
IGM is < 50% neutral at z = 6.5 (jRhoads fc Malhotr j 
20QTI: iMalhotra fc Rhoadg ^200^; "Stern et aL .20051 
Kashikawa et al.l 12006: Malhotra fc Rhoads 200l). This 
complements the Gunn-Peterson lower bound of xhi ^ 
1% at z ^ 6.3. Completely independently, polarization 
of the cosmic microwave bakground sugg ests a central 
reionization redshift Zre = 10.5 ± 1.2 (^Komatsu et al.l 

Hoio). 

In addition to their utility as probes of reioniza- 
tion, Lya emitters are valuable in understanding 
galaxy formation and evolution at the highest red- 
shifts. This is especially true for low mass galax- 
ies, as Lya emitters are observed to have stellar 
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masses M^ < 10^ Mc^^ fCawiser et al.""2006"; "Pirzkal et all 
[2007; Fi nkelstein et al. 2007 ; Pentericci et a l. 2009), ap- 
preciably below the stel lar masses of Lyma n break se- 
lected galaxie s fLBG) (jSteidel et a l.* * 19961 ) at similar 
redshifts (e . g. iPapovich et al.l 1200 l^TshaDleveTall 120011 : 
Stark et al.J|2009D. ^ 

Narrow-band imaging is a well established tech- 
nique for finding: hig h reds hift galaxies (e.g;. Rhoadsl 
^OOa"; 'Rhoads et al.l "2004', "2003V IMalhotra fc'Rhoadsl 
2002, 2004; Cowie & Hu 1998; Hu et al. 1999, 2002, 2004; 
Kudritzki et al. 2000; Fvnbo et al. 2001; Pentericci e t al.l 
^00; Ouchi et al. 2001," 2003, 2008; Stiavelh et al. 20m 
Shimasaku et al.l l2006l: lKodaira et a l. 2003: lAiiki eTail 
200 41: iTa niguchi eFall [20051: 
Kashikawa et al.l 12006 : [ 



2007^ .Finkelstein et al 



2004; 



ilve et al 
I2009D. The 
redshifted into 
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120061 : iNilsson et al.l 
method works be- 



cause Lya emission redshifted into a narrow band 
filter will make the emitting galaxies appear brighter 
in images through that filter than in broadbands of 
similar wavelength. A supplemental requirement that 
the selected emission line galaxies be faint or unde- 
tected in filters blueward of the narrowband filter effec- 
tively weeds out lower redshift emission line objects (e.g. 
Malhotra & Rhoads 2002). This has proven to be very 
efficient for selecting star-forming galaxies up to z < 7, 
and remains effective even when those galaxies are too 
faint in their continuum emission to be detected in typi- 
cal broadband surveys. 

While large samples of Lya emitters have been de- 
tected at z <6, both survey volumes and sample sizes 
are much smaller at z >6. Since the Lya photons are 
resonantly scattered in neutral IGM, a decline in the ob- 
served luminosity function (LF) of Lya emitters would 
suggest a change in the IGM phase, assuming the num- 
ber density of newly formed galaxies remains constant at 
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each epoch. iMalhotra fc Rhoadsl (|2QQ4f ) found no signif- 
icant evolution of Lyo ^ LF between 2^=5.7 and z=6.6, 
while iKashikawa et al.l (|2QQ6l ) suggested an evolution of 
bright end of the Lya LF in this redshift range . At even 
higher redshifts, z = 6.5 to 2;=7, some authors (live et al.l 
[2006; Ota et al. 2008) suggest an evolution of the Lya 
LF however based on a s ingle detection. 

Recently, iHibon et al.l ([2009) found seven Lya can- 
didates at z=l.l using the Wide-Field InfraRed Camera 
on the Canada- France-Hawai'i Telescope. If these seven 
candidates are real and high redshift galaxies, the de- 
rived hy a LF su ggest no strong evolution from z=6.5 
to z=l.l. 1st ark et al. (2007) found six candidate Lya 
emitters at2;^8 — lOina spectroscopic survey of grav- 
itationally lensed hya e mitters. Other se arches (e.g. 
[Parkes et al. 1994 jWillis & Courbin 2005^ ICubv et al.l 
[2007; Wilhs et al. 2008; Sobral et al 2009) at redshift 
z >8 either had insufficient volume or sensitivity, and 
hence did not find any Lya emitters. 

In this paper we present a search for Lya emitting 
galaxies at z =7.7, selected using custom-made narrow- 
band filters that avoid night sky emission lines and there- 
fore are able to obtain low sky backgrounds. This paper 
is organized as follows. In section [2l we describe in detail 
the data and reduction. In section [3] we describe our se- 
lection of Lya galaxy candidates. In section|3]we discuss 
possible sources of contamination in the sample, and our 
methods for minimizing such contamination. In section 
5 we estimate the number of Lya galaxy candidates ex- 
pected in our survey using a full Monte Carlo simulation. 
In section 6 we discuss the Lya luminosity function, and 
in section 7 we compare the Lya equivalent widths with 
previous work. We summarize our conclusions in section 
8. Throughout this work we assumed a flat ACDM cos- 
mology with parameters r^rn=0-3, r^A=0.7, /i=0.71 where 
^A, and h correspond, respectively to the matter 
density, dark energy density in units of the critical den- 
sity, and the Hubble parameter in units of 100 km s~^ 
Mpc~^. All magnitudes are in AB magnitudes unless 
otherwise stated. 

2. DATA HANDLING 
2.1. Observations and NEWFIRM Filters 

We observed the Large Area Lyman Alpha sur- 
yey (LALA) C etus field (RA 02:05:20, Dec -04:53:43) 
(jRhoads et al.ll2000b[ ) during a six night observing; run 
with the NOAO0 Extre mely Wid e-Field Infrared Mo- 
saic (NEWFIRM) imager (|Autrv et al. 2003) at the Kitt 
Peak National Observatory's 4m Mayall Telescope dur- 
ing October 1- 6, 2008. 

We used the University of Maryland 1.063 jim ultra- 
narrowband (UNB) filter, for a total of 28.7 hours of 
integration time, along with 5.3 hours' integration in 
the broadband J-filter. Both narrow- and J-band data 
were obtained on each clear night of observing. NEW- 
FIRM covers a 28' x 28' field of view using an array 
of four detector chips arranged in a 2x2 mosaic, with 
adjacent chips separated by a gap of 35''. Each chip is 
a 2048x2048 pixel ALADDIN InSb array, with a pixel 
scale of 0.4" per pixel. The instantaneous solid angle 
coverage of the NEWFIRM camera is about 7450'. 

^ National Optical Astronomy Observatory 



The LALA Cetus field has been previously studied at 
shor ter wavelengths, most notably by the LAL A sur- 
vey (jMalhotra fc Rhoadsl[2QQ2l : iWang et al.ll2009[ ) in nar- 
row bands with Ac ~656, 660, 664, 668, and 672 nm, 
and AA « 80 A); the NOA O Deep Wide Field Survey 
(NDWFS) (jJannuzi fc Devi 1 1999 ). with broadband opti- 
cal B^y, R, a nd I filters; using MMT /Me^acam g', r', i' 
and z' filters (|Finkelstein et all 20071): and Chand r a, wit h 
180 ksec of ACIS-I imaging (jWang et all [2QQ1 . [2QQ7h . 
In summary, we use narrow-band UNB fc broadband 
J data obtained using NEWFIRM, and previously ob- 
tained B^, R, and I -band data (NDWFS) for this study. 
The MMT/Megacam images cover about 55% of the area 
we observed with NEWFIRM, a nd we used these deeper 
optical g', r', i' and z' images (Finkelstein et alj l2007|) 
to check our final Lya candidates where possible (see 
section 3 below). 

The J filter on NEWFIRM follows the lTokunaga et all 
(2002) filter specifications, with Ac = 1.25/im and a 
FWHM of 0.16/im. The UNB filter is an ultra narrow- 
band filter, similar to the DAzLE narrow-band filters 
(|Horton et al.ll200"^ . centered at 1.063 jim with a full 
width at half maximum (FWHM) of 8.1 A. We used 
Fowler 8 sampling (non-destructive readout) in all sci- 
ence frames. In the UNB filter, we used single 1200 sec- 
ond exposures between dither positions; in the J band, 
two coadded 30 second frames. 

The NEWFIRM filter wheel places the filters in a col- 
limated beam. As a consequence, the effective central 
wavelength of the narrowband filter varies with position 
in the field of view. Beyond a radius of 12', the cen- 
tral wavelength of the UNB filter shifts sufficiently to 
include two weak OH emission lines in the bandpass, 
which appear as concentric rings in the narrowband im- 
ages, and which limit the survey area where the filter's 
maximum sensitivity (limited by only the inter-line sky 
background) can be achieved. Figure 1 shows the nar- 
rowband filter transmission curve along with night sky 
OH emission lines. The UNB filter is designed to avoid 
OH lines. 

2.2. Data Reduction 

We reduced UNB fc J-band data using a combination 
of standard IR Alfl tasks, pre dominantly from the mscred 
(|Valdeslll998D and nfexteriE (iDickinson fc Valdes ll2009h 
packages, along with custom IDL0 reduction procedures. 

To remove OH rings from UNB data, we created a ra- 
dial profile for each individual exposure, smoothed over a 
small radius interval dr, and subtracted this profile from 
the exposure. We then performed sky subtraction by me- 
dian averaging two OH ring-subtracted frames that were 
taken immediately before and two frames after the sci- 
ence frame in consideration. We then performed cosmic 
ray rejection on sky- su btracted frames, using the algo- 
rithm of Rhoadi (|2000af ). Prior to fiat-fielding performed 
using dome-flats, we created a bad pixel mask for each 
science frame by combining the cosmic ray flagged pix- 

^ The Image Reduction and Analysis Facility (IRAF) is dis- 
tributed by the NOAO, which is operated by the Association of 
Universities for Research in Astronomy, Inc. (AURA) under the 
cooperative agreement with the National Science Foundation. 

^ An external IRAF package for NEWFIRM data reduction 

^ Interactive Data Language 
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Fig. 1. — Normalized narrowband filter transmission curve 
(green line) and night-sky OH emission lines ( Rousselot et al. 2000) 
(black line) with arbitrary flux. Here we have shown the transmis- 
sion curve (at the center of the fleld) of only narrowband fllter to 
demonstrate the use of very narrow region between OH lines, to 
search for Lyo; emitters at z=7.7. Tw o weak OH emission lines 
with A = 1.05888 and 1.05754/im (Rousselot et al.' 2000) appear in 
the UNB images as concentric rings beyond 12' radius, since the 
central wavelength of the UNB fllter shifts to the blue for positions 
away from fleld center. 

els with a static bad pixel mask for the detector. We 
then replaced all bad pixels with zero (which is the back- 
ground level in these sky-subtracted images) prior to any 
resampling of the frames. We adjusted the World Coor- 
dinate System of individual frames by matching the point 
sources to the 2MASS point source catalog using IRAF 
task msccmatch. We then combined the four chips (i.e 
four extensions) of each science exposure into a single 
simple image using the mscimage task in IRAF, which 
interpolates the data onto a common pixel grid. Here 
we used sincll for the interpolation. Using mscstack in 
IRAF, we then stacked all of the narrowband exposures 
into a single, final narrowband stack. Pixels flagged as 
bad are omitted from the weighted averages in this step. 
The average FWHM of our final narrowband stack was 
1.36". In addition to this stacked image, we also gen- 
erated individual night stacks, which were later used to 
identify glitches in Lya candidate selection. 

For broadband J-filter data reduction, we followed es- 
sentially the same procedure, modified by omission of the 
OH ring subtraction which is rendered unnecessary by 
the absence of noticeable OH rings in the much broader 
J bandpass. 

We now assess the accuracy of sky subtraction method, 
the distribution of noise, and the uncertainty in the as- 
trometric calibration of the UNB and J-band stacks. To 
evaluate the sky subtraction, and to understand the noise 
distribution we constructed sky back ground, and back- 
ffround noise maps using SExtractor (jBertin fc ArnoutsI 
11996). The sky subtraction is sufficiently uniform 
throughout the image except in the corners i.e. beyond 
the OH lines affected regions. The noise, due to sky 
brightness, is also consistent with the expected Poisson 
noise distribution from sky photons. 

To evaluate the uncertainty in the astrometric calibra- 
tion, we compared the world coordinates of the sources 
in the UNB stack (obtained using SExtractor) and the 



corresponding object coordinates from the 2MASS cat- 
alog. We found that the uncertainty in the astrometric 
calibration is very small, and independent of the position 
in the UNB image. The rms of the matched coordinates 
of UNB and 2MASS is about 0.2 and 0.3 arcseconds cor- 
responding to RA and DEC respectively. 

We obtained reduced stacks of deep optical broadband 
data in B^^, R, and I filters, previously observed by the 
NOAO Deep Wide Field Survey (NDWFS). 

At the end, we have one deep UNB stack, along with 
five single- night UNB stacks, four broadband stacks in 
J, R, and I filters, and fo ur deep stacks in g', r', i' 
and (jFinkelstein et alll2009f ). All the stacks were then 
geometrically matched for ease of comparison. 

2.3. Photometric Calibration 

We performed photometric calibration of UNB & 
J-band (Jnf) data by comparing unsaturated point 
sources, extracted using SExtractor, with 2MASS stars. 
From 2MASS catalog we selected only those stars that 
had J-band (J2m) magnitudes between 13.8 & 16.8 AB 
ma £3, and errors less than 0.1 magnitude. Since four 
quadrants of the UNB stack had slightly different zero- 
points, we scaled three quadrants, selected geometrically, 
to the fourth quadrant, which was closest to the mean ze- 
ropoint, by multiplying each quadrant with suitable scal- 
ing factors so as to make zero-point uniform throughout 
the image. We then obtained zero-points for UNB and 
Jnf by minimizing the difference between UNB & J2M , 
and between Jnf & J2M respectively. This left 0.09 rms 
mag between J2M & Jnf magnitudes, and 0.07 rms mag 
between UNB & J2M magnitudes. The photometric cal- 
ibration was based on about 30 & 80 2MASS stars for 
narrow-band and J-band respectively. So the accuracy of 
the photometric zero points is about ±0.02 mag in both 
J and UNB filters. 

In addition to the error we have already estimated, 
there is some uncertainty arising due to different filter 
widths, and differing central wavelengths of the 2MASS 
and UNB filter. To estimate this uncertainty we con- 
structed observed spectral energy distribution (SED) of 
stars that were common to both, the UNB image and 
g', r', i', z', J, H, & K images. From each SED linearly 
interpolated fiux at central wavelengths of the UNB filter 
and J-filter were measured. From these SEDs we found 
the median offset between the UNB and J band to be 
< 0.1 mag. This residual color-term uncertainty in the 
photometric zero points is smaller than the photometric 
fiux uncertainty in any of our Lya candidates. 

Before we proceed to calculate the limiting magni- 
tudes, we estimate the sky brightness between the OH 
lines in the UNB image. To estimate this sky value, we 
construct the UNB stack in the same way as described 
in Section 2.2 but omitting the OH ring subtraction, and 
sky subtraction. In addition, we subtracted dark cur- 
rent counts from each raw frame. We estimated the av- 
erage sky brightness in the UNB image by selecting 30 
random regions avoiding astronomical objects and OH 
rings. This gives us the sky brightness, between the OH 
lines, of about 21.2 mag arcsec"^ equivalent to 162 pho- 

Since J2M magnitudes are in Vega, we adopted the following 
conversion between Vega and AB magnitudes : Jab=J2M + 0.8 
mag 
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tons arcsec"^ /im~^. This sky brightness is 

much fainter than the J-band sky brightness which is 
about 16.1 mag arcsec"^ equival ent to 17QQQ photons 
s~^ m~^ arcsec"^ /im~^ (Maihar a et al.l [l993) . How- 
ever, more careful analysis are needed to estimate the 
interline sky brightness in the UNB images. 

2.4. Limiting Magnitudes 

To obtain limiting magnitudes of stacked images, we 
performed a series of artificial source simulations. In 
each, we introduced 400 artificial point sources in an 0.1 
magnitude bin of fiux in the final stacked image. The po- 
sitions were chosen randomly, but constrained to avoid 
places close to bright stars and already existing sources. 
We then ran SExtractor, with the same parameters as 
were used for the real source detection (see Section 3), 
to calculate the fraction of recovered artificial sources. 
We ran 20 such simulations in each 0.1 magnitude bin 
from UNB = 21 to 24 mag. The 50% completeness level 
is UNB= 22.5 mag, which corresponds to an emission 
line fiux of 6 x 10~^^ ergcm"^ s~^. The very narrow 
bandpass results in a relatively bright continuum limit 
(compared to more conventional narrowband filters with 
1% to 1.5% bandpass), but the conversion between nar- 
rowband magnitude and line fiux is extremely favorable, 
so that our line fiux limits are competitive with any nar- 
rowband search in the literature. The 50% completeness 
for other filters B^^, R, I, and Jnf correspond to 26.3, 
25.4, 25.0, and 23.5 mag respectively. 

3. Lya CANDIDATE SELECTION 

We identified sources in the stacked narrowband image 
using SExtractor. To measure their fiuxes at other wave- 
lengths, we first combined the broad-band o ptica l images 
B^;, R, I into a single chi-squared im age (jSzalav et al.l 
I1999D constructed using g^ar Bertin et al.l [2QQ2t) . A 
chi-square image is constructed using the probability dis- 
tribution of sky pixels in each of the images to be com- 
bined, and extracting the pixels that are dominated by 
object fiux. We then used SExtractor in dual-image 
mode in order to measure object fiuxes in both the broad 
J filter and the combined optical chi-squared image. In 
dual image mode, a detection image (UNB in this case) 
is used to identify the pixels associated with each object, 
while the fiuxes are measured from a distinct photometry 
image. 

To identify Lya candidates in our survey, we used the 
combined optical image, UNB image, and J-band image. 
Each Lya candidate had to satisfy all the following 
criteria: 

(a) 5(7 significant detection in the UNB filter, 

(b) 3(7 significant narrowband excess (compared to the 
J band image), 

(c) flux density ratio fj,{UNB)/fj,{J) > 2, 

(d) non-detection in the combined chi-square optical 
image (with < 2a significance), 

(e) consistent with constant fiux from night to night 
(see Section 3.1), and 

(f) non-detection in individual optical images. 

Swarp is a software program designed to resample and com- 
bine FITS images. 



Criteria a-c ensure real emission line sources. Criterion 
d eliminates most low-redshift sources, e eliminates time 
variable sources and other glitches, and criterion / elimi- 
nates LBGs at z > 4 which might show up more clearly in 
the R or I band than in t he image We also used deeper 
optical images (iF inkelste in et al. 2007) in the overlap- 
ping field between MMT/Megacam and NEWFIRM for 
criterion /. 

The criteria follow the successful searches for Lya 
galaxies at lower redshifts of z=4.5 and 5.7, which hav e ^ 
70 — 80% spectroscopi c suc cess rate (Rhoads & Mal hotral 
[200 II: Rhoads et al.1 120031 : iDawson et al.l 12004 I2QQ7I : 
iWang et al 200^91) . 

3.1. Constant flux test 

In our constant fiux test (criterion e above), we looked 
at the variation of fiux of each Lya candidate over five 
nights. We reject any source having individual night 
stack fiuxes close to zero or showing fiux variations above 
a certain chi-square value. To do this, we generated light- 
curves of each candidate using individual night stacks of 
UNB, and then determined the of the data with re- 
spect to the best-fitting constant fiux. Since we had five 
nights of data, we selected only those candidate that had 
a chi-square <5. This is in addition to requiring s/n > 5, 
which guards against peaks in the sky noise entering the 
candidate list. 

We also eliminated all the sources that were very close 
to the chip boundaries. Combining these criteria with 
the set of criteria from Section 3, we had six Lya emit- 
ter candidates. To increase the reliability of these candi- 
dates, we finally selected four candidates after indepen- 
dent visual inspection by four of the authors. Figure 2 
shows postage stamps of all four Lya candidates. The 
candidates are clearly visible in the UNB images (mid- 
dle panel) , while undetected in the combined optical (left 
panel) , and J band images (right panel) . We provide the 
coordinates of our Lya candidates in Table 1. 



TABLE 1 

Coordinates of our Lva candidates. 



RA(J2000) DEC (J2000) 
LAE 1 02:04:45.9 -04:53:00.8 
LAE 2 02:04:41.3 -05:00:11.5 
LAE 3 02:04:53.2 -04:46:43.8 
LAE 4 02:05:58.0 -05:05:48.4 



4. CONTAMINATION OF THE SAMPLE 

While we have carefully selected Lya candidates 
based on photometric and geometric criteria, it is pos- 
sible that our Lya candidates can be contaminated 
by sources that include transient objects such as super- 
nova, cool stars (L & T dwarfs), foreground emission 
line sources, and electronic noise in the detector. We 
now discuss the possible contribution of sources that can 
contaminate our Lya candidate sample. 



Our 



4.1. Foreground emission line objects 
Lya candidate selection can include fore- 



ground emission line sources including [O ll] emitters 
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Fig. 2. — Postage stamps (50^^ wide) of all four Lya candidates in combined (chi-square) optical image (left panel), UNB (middle), 
and J-band filter (right panel). The positions of Lyo; candidates are marked with circles 16^^ in diameter. 



(A = 3727A) at z=1.85, [Oiii] (A = 5007A) emitters 
at z=1.12, and Ha(A = 6563A) emitters at z=0.62, if 
they have strong emission hne flux but faint continuum 
emission. We now estimate the number of foreground 
emitters that can pass our Lya candidate selection cri- 
teria. 

In our UNB stack, the 50% completeness limit corre- 
sponds to a flux of 6 X 10~^^erg s~^ cm~^. Therefore 
the minimum luminosities required by the foreground 
emission line sources to be detected in our survey are 
1.5 X lO'^^erg s-\ 4 x lO'^^erg s-\ and 1 x lO'^^erg s"^ 
for [O ll] , [O III] , and Ha emitters respectively. 

Given the depth of our combined optical image, we 
can calculate the minimum observer frame equivalent 
width (EWmin) that would be required for an emission 
line object to be a Lya emitter candidate. We calcu- 
lated the observer frame EW using the following relation 
(jRhoads fc Malhotral[2QQTh : 



erg cm s 
cm~^s~^Hz~^, 



^]lz~^ and 2<Jbb = 
we found that the 
sources would require 



EWn 



fnb 
fbb 



AA 



nb 



5<Ji 



nb 



2crbb 



AA, 



(1) 



where fnb and fbb are the fluxes in UNB and combined 
optical image respectively, AAnb is the UNB filter 
width, and a^h and <Jbb are the uncertainties in flux 
measurements in UNB and combined optical image 
respectively. (The implicit approximation that the 
continuum contributes negligibly to the narrowband 
flux, is well justified for our 9 A bandpass.) With 



5anb = 7.8 X 10 
1.5 X 10-^°erg ( 

foreground emission line sources would 
EWmin ^ 460A to contaminate our Lya candidate 
sample. 

Foreground [Oil] and [O ill] emitters: Unfortu- 
nately, the equivalent width distribution of [Oil] emit- 
ters has not been dir ectly measured at z =1.85. How- 
ever, several authors (iTeplitz et al.|[2QQ3l : iKakazu et al.l 
l2QQ7l : lStraughn et all2QQ9[ ) have studied [O ll] emitters at 
z <1.5. Here w e use [ ll] EW distribution, obtained by 
"Strau ghn et (2009) at (z) ^1 in GOODS-south field, 
with the assumption that there is no significant evolution 
of the [Oil] LF from z=l to z=1.85. In our Lya can- 
didate selection, emission line sources with Iab fainter 
than 25.9 magnitude, and with EWobs > 460A can con- 
taminate our sample. We determined which sources from 
Straughn et al. (2009) would have passed these criteria if 
redshifted to z = 1.85, and scaled the result by the ratio 
of volumes between the two surveys. We find that less 
than one (0.1) [OH] emitter is expected to contaminate 
our Lya candidate sample. To be conservative, even if 
we relax the above magnitude cut by 0.5 mag to account 
for any color correction, and lower the EWobs > 200A, 
we find that less than 0.3 [On] emitters should be ex- 
pected to contaminate our sample. 

We apply a similar methodology to estimate the 
contamination from foreground [Olll] emitters 
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(iKakazu et all I2QQ7I : iHu et all I2QQ9I : IStraughn etaU 
[20091 [2QTqI ) at (z) ^ 1.1 in our NEWFIRM data 
usin^ the [Oll l] emission line sources at (z) =0.5 in 
IStraughn et al.l ([2009). We found that less than two 
(1.7) [Olll] emitters can be misidentified as Lya 
emitters in our survey. In addition to the above esti- 
mate, we used a recent sample of emission line galaxies 
obtained from HST WFC3 early release science data 
(IStraughn et al.ll2010r ). This sample of [O III] emitters is 
closer in redshift, with median z = 1.1, to our foreground 
[Olll] interloper redshift of z = 1.12, thus minimizing 
the error in our [O III] estimate due to possible evolution 
in the LF of [O ill] emitters. Using this recent sample, 
we found that about one [O ill] emitter is expected to 
contaminate our Lya candidate sample. 

Foreground Ha emitters: As mentioned ear- 
lier, Ha emitters at z=0.62 can cont aminate our 

Lyg candidate samp le. ^Several authors (jTresse et al.l 

120021 : IStraughn erafl l2009t) have studied Ra emitters 
at similar redshift. iTresse et all (j2002r ) (see their Fig- 
ure 6) have plotted the Ra luminosity vs the contin- 
uum B-band magnitude of Ra emitters. To pass our 
selection criteria, an Ra emitter would require a lu- 
minosity greater than 1 x lO^^erg s~^, and flux den- 
sity /b^ < 7.5 X 10~^^erg cm~^s~^Hz~^ which corre- 
sponds to Mab = —15.97 mag. Any source brighter than 
Mab =-15.97 mag would be detected in the B^j image, 
and hence rejected from Lya candidate list. From figure 
6 (jrVesse et a l. 2002), we expect to find no sources that 
can pass this selection criteria. In addition , we used Ha 
emitters at (z)=0.27 (Straughn e t al.|[2009i) . and found 
that less than one (0.4) Ha emitters are expected to con- 
taminate our Lya candidate sample. 

4.2. Other Contaminants 

Transient objects : We rule out the possibility of 
contamination of our Lya candidates by transient 
objects such as supernovae, because these objects would 
appear in both UNB and J band stacks. Both UNB and 
J data were obtained on each clear night of the run. 

L and T Dwarfs : Following iHibon et all (l2009[ ) we 

determined the expected number of L/T dwarfs in our 
survey. From the spectral typ e vs. absolute magnitude 
relations given by figure 9 in iTinnev et al.l ()2003l ). we 
infer that we could detect L dwarfs at a distance of 400 
to 1300 pc and T dwarfs at a distance of 150 to 600 pc, 
from the coolest to the warmest spectral types. 

Our field is located at a high galactic latitude, so that 
we would be able to detect L/T dwarfs well beyond the 
Galactic disk scale height. However, only a Galactic disk 
scale height of 350 pc is applic able to the population of 
L/T dwarfs ( Rvan et al.ll2005l ). We derive then a sam- 
pled volume of ^ 750 pc^. Considering a volume density 
of L/T dwarfs of a few 10~^ pc~^, we expect no more 
than one L/T dwarf in our field. 

While we expect about one L/T dwarf in our survey, 
we further investigate if any of the observed L/T dwarf 
pass our selection criteria. To do this we selected about 
160 observed spectra of L/T dwarf (|Golimowski et al.l 

http:/ /staff.gemini.edu/~sleggett/LTdata.html 



i et al. 

|2QQ3 : iKnapp et al] l2003 : iChiu et al.l 1200611 . and cal- 
culated the flux transmitted through the UNB and 
J-band filter. We found that none of the L/T dwarf 
has sufficient narrowband excess to pass our selection 
criteria. Therefore it is unlikely that our Lya candidate 
sample is contaminated by L/T dwarf. 

Noise Spikes: Noise in the detector can cause 
random fiux increase in the UNB filter. To avoid 
contamination from such noise spikes, we constructed 
light curves of each candidate using individual night 
stacks i.e. we selected candidates only if their fiux was 
constant over all nights. This method of candidate 
selection based on the constant fiux in the individual 
night stacks also eliminates the possible contamination 
from persistence. 

Contribution from false detection: Finally, we 
performed a false detection test to estimate the num- 
ber of false detection that can pass our Lya selection 
criteria. To do this we multiplied the UNB stack by -1 
and repeated the exact same procedure as the real Lya 
candidate selection (see section 3). We did not get any 
false detection passing our selection criteria. 



5. MONTE-CARLO SIMULATIONS 

Based on the above estimates less than two [O ill] emit- 
ters are expected to be misidentified as Lya emitters 
in our survey. To estimate the number of sources that 
should be detected in our survey for a given Lya LF, 
we performed detailed Monte-Carlo simulations. This 
is needed, since the width of the filter is comparable to 
or slightly smaller than the expected line width in these 
galaxies, so many of the sources will not be detected at 
their real line fiuxes. In these simulation^ we used the 
z = 6.6 Lya LF derived bv lKashikawa et al.l (|2006l ). 

First, we generated one million random galaxies dis- 
tributed according; to t he observed Lya LF at z=6.6 
(jKashikawa et al.l 120061 ). Each of these galaxies was as- 
signed a Lya luminosity in the range 1 x 10^^ < Lya < 
1.5 X lO^^erg s~^. Here we assumed that the Lya LF 
does not evolve from z=6.6 to z=7.7. Each galaxy was 
then assigned a random redshift zl < z < zh where zl 
and Zh correspond to the minimum and maximum wave- 
lengths where the transmission of the UNB filter drops 
to zero. 

Next, to each galaxy we assigned a fiux F = LLyQ;/47rdL 
where dL is the luminosity distance. We distribute this 
fiux in wavelength using an asymm etric Lya line profil e 
drawn from the z = 5.7 spectra of iRhoads et al.l (|2003l ). 
The fiux transmitted through the UNB filter was then 
determined as ftrans = / fxTxdX (where Tx is the filter 
transmission and fx the flux density of the emission line). 
This accounts for the loss of the Lya flux that results 
from a fllter whose width is comparable to the line width 
(and not much greater as would be the case for a 1% 
fllter). We then created a histogram of magnitudes after 
converting the convolved flux to magnitudes calculated 
using the following relation: 

magAB = -2.5 Logio ^^^^^ , (2) 



The Luminosity Function of Lyman alpha Emitters at Redshift z = 7.7 



7 



10" 



10'* 



10' 



10' 



1 ' ' ' 1 ' ' ' 1 ' 

• z=7.7 Tilvi et al (This study) 
o z=7.7 Hibon et al 09 
□ z=6.96 lye et al 06 



=6.5 Kashikawa et al 06 

=5.7 Ouchi et al 08 

_i 1 1 1 I 1 i_ 



42.4 42.6 42.8 43.0 

Lya Luminosity (erg s"^) 



43.2 



Fig. 3. — Cumulative Lyo; luminosity function of our z=7.7 
candidates (filled circles). The filled points show the LF that will 
result if all four Lya galaxy candidates are confirmed. The upper 
error bars are Poisson errors based on our sample size, while the 
down-arrows below each data point indicate the possibility of a 
lower LF if some candidates are extreme emission line galaxies at 
lower redshift. The open circles represent the LF from Hibon et all 
(|2009l ) while the dashed line and dott ed line show Lya LF s at 
=5.7 (lOuchi et al. | l2008h and z=6.5 (IKashikawa et al.|[2q06h re - 



spectively. The open square is the LF at 2:=6.96 (jive et al 



and 



_ 3.6 kJy X c 
(1.06/i)2 



Tx d\ erg s ^cm ^, 



(3) 



with c the speed of Hght. 

Lastly, to include the instrumental effects, we multi- 
plied the number of galaxies in each magnitude bin by 
the corresponding recovery fraction obtained from our 
artificial source simulations in our UNB image (see sec- 
tion 2.4). We then converted each magnitude bin to a 
Lya luminosity bin, and counted the number of detected 
galaxies in each luminosity bin. 

We repeated this simulation ten times, and taking an 
average, we found that about one Lya emitter should 
be expected in our survey. It should be noted that we 
assumed a non-evolving Lya LF from z=6.6 to z=7.7, 
and that every Lya emitter has the same asymmet- 
ric Lya fine profile. While we expect about one Lya 
emitter in our survey there are large uncertainties mainly 
due to the Poisson noise, and field to field variation or 
cosmic variance. iTilvi et al.l (|2QQ9f ) have estimated field 
to field variation of Lya emitters to be > 30% for a 
volume and fiux limited Lya survey with a survey vol- 
ume ~ 2 X 10^ Mpc^. We expect a larger field to field 
variation for smaller survey volumes. We also estimated 
the cosmic variance expected in our survey using the cos- 
mic variance calculator f Trenti fc Stiavelli 2008 ) . For our 
survey we should expect a cosmic variance of about 58% 
assuming an intrinsic number of Lya sources at z = 7.7 
in agreement with a no n-evolving Lya LF from z = 6.6 
(jKash ikawa et al."2006l io z = 1.1. On the other hand 
our candidate counts are quite consistent w ith the lumi- 
nosity function at z=5.7 ()Ouchi et al.ll2009[ ). 

6. Lya LUMINOSITY FUNCTION AT Z=7.7 



Usin g a large sample of Lya candidates, I Ouchi et al.l 
(|2008l ) found no significant evolution of Lya LF 
between z=3.1 and z=5.7. The evolution of the Lya 
LF between z =5.7 and z = 6.5 i s not conclusive. 
For example, Malhot ra fc Rhoadsl ([2004') found no 
significant evolution of Lya LF betwee n z=5.7 
and z = 6.5, while IKashikawa et al.l (|2006l ) suggest 
an evolution of bright end of the LF in this red- 
shift range. On the theor eti cal fr ont , several models 
Thommes fc Meisenheimerl __j2QQ5l: iF urlanet to et al.l 



200 5: Le Delliou et al. 2 QQg; iDiik stra et a l. |2QQ7 



Kobavashi et al. 2007; McQuinn et al. 2007; Dayal et al I 
20081: iNagamine et al. 2008: Samui etld] 120091 : 



UN agamme 

Tilvi et al] l2009l ) have been developed to predict 
reds hift evolution of the Lya LF. While several models 
fe.g. lSamui et all 120091 : [Tilvi et al.l [2009) predict no sig- 
nificant evolution of Lya LF at z < 7, the predictions 
differ greatly among different models. These differences 
among the models can be attributed to differing input 
assumptions, which in turn stem from our imperfect 
understanding of the physical nature of Lya galaxies, 
and from the small samples currently available at high 
redshift. 



At z > 6.5, there are o nly a few searches for Lya 
emitters, live et al.] (|2006l ) found one spectroscopically 
confirmed LAE at z=6.96, and currently there are no 
spectroscopically confirmed LAEs a t z > 7. However , 
there are few photometric searches ( Parkes et al.lll99l; 
Willis fc CourbinI [20051 : iCubv et all 120071 : iHibon et al.l 



20091 ) for Lya galaxies, and constraints on Lya LF at 
z > 1. Table 2 shows details of different Lya searches 
at z >1. 

After careful selection of Lya candidates and elimi- 
nating possible sources of contamination, we have found 
four Lya emitter candidates in a survey area of 28 x 28 
arcmin^, with a limiting fiux of 6 x 10~^^erg s~^ cm~^ . 
The fluxes of these four candidates are 1.1, 0.91, 0.84 and 
0.72 in units of 10~^^ erg s~^ cm~^. Fig. 3 shows the re- 
sulting cumulative Lya luminosity function. Solid filled 
circles show the Lya LF derived from ou r candidates, 
while open circles represent Lya LF from iHibon et all 
(|2009l ). Arrows indicate that this is the upper limit on 
the Lya LF, and upper error bars are the Poisson 
errors. The dotted and dashed lines show Lya LFs 
from lOuchi et all ((2008) and IKashikawa et all ([2006) re- 
spectively. Tlie open square is the Lya LF at z=6.96 
(|Ive et al.ll2006h . 

If all of our Lya candidates are z=l.l galaxies, the LF 
derived from our sampl e shows mode rate evolution com- 
pared to LF at z=6.5 (jKashikawa et al.l 120061 ). On the 
other hand, conservatively if only one of the candidates 
is a z = 7.7 galaxy, then the Lya LF does not show any 
evolut ion compared to the z = 6.6 Lya LF. IHibon et al.l 
(|2009l ) conclude that the observed Lya LF at ^ = 7.7 
does not evolve significantly compared to Lya LF at 
z=6.5 (Kashikawa et al. 2006), if they consider that all 
of their candidates are real. Fi nally, while our Lya LF 
lies above the LF obtained bv IHibon et al.l (|2009l ). the 
counts are consistent with the number of star-forming 
galaxies in the HUDF wi th inferred Lya line fluxes 
> 6 X 10"^^erg s"^ cm"^ ([Finkelstein et al.ll2009bh . and 
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TABLE 2 

SEARCHES AT Z >7. 



2; 


kJ Li± \ \D y 


-L^ VZy U vZy Ulv-^Xl 111111 UO 


No of L AE 


Ref. 




volume (Mpc^) 


erg s""*^ 


candidates 




7.7 


1.4 X 10^ 


6 X 10"^^ 


4 


This study 


7.7 


6.3 X 10^ 


8.3 X 10"^^ 


7 


Hibon et al 2009 


8-10 


35 


2 X 10"^'^ 


6 


Stark et al 2007 


8.8 


3 arcmin^ 


- 10-^^ 





Parkes et al 1994 


8.8 


991 


2 X 10"^^ 





Willis et al 2005 


8.8 


6.3 X 10^ 


1.3 X 10"^^ 





Cuby et al 2007 


8.96 


1.12 X 10^ 


6 X 10"^^ 





Sobral et al 2009 


- 9 


-450 


3.7 X 10"^^ 





Willis et al 2008 



also consistent with the Lya LF at 2^=5.7 (|Ouchi et al.l 

Egos). 

As described in Section 5, all surveys for Lya emitters 
at z > 6 suffer from cosmic variance. We do expect to 
see field-to-field variation in number counts even at the 
same redshift. Therefore it is important to get statistics 
from more than one field for each redshift. The field- 
to-field variation is expected to be stronger for brighter 
sources. Therefore the higher redshift surveys, which are 
more sensitivity limited, are hit the hardest. 

7. Lya EQUIVALENT WIDTH 

Several studies have found numerous Lya emitters 
having large rest-frame equivalent widths , E W r est > 
240A (iMa lhotra & Rhoads 2002; Shimasa kueFalJl2006l: 
Dawson et al. 2007: Gronwall et al. 2007; lOuchi et all 
20081 ) . These exceed theoretical predictions for normal 
star forming galaxies. 

Since the J-band filter does not include the Lya line, 
we have used the following relation to calculate the rest- 
frame Lya EWs for our four Lya candidates: 



EW. 



NB 
v,BB 



1 



(1 + z) 



(4) 



Here fNB and fA,BB are the UNB line flux (erg s ^cm^), 
and J-band flux (erg s~^ cm^ A~^) respectively. Since 
none of the four candidates are detected in J-band, we 
used J-band limiting magnitude to calculate a lower limit 
on the Lya EWs. We note that the Lya EW will 
depend on the exact redshift, shape, and precise position 
of the Lya line in the UNB filter. However, for simplicity 
and because we only put lower limits on EWs, we assume 
that the UNB filter encloses all the Lya line flux in 
calculating EWs. 

For our Lya candidates, with line flux estimates from 
7 to 11 X 10~^^ ergcm"^ s~^, and our broad band limit 
Jnf ^ 23.5 mag, we find Lya EWrest ^ 3A. 

This EW limit is considerably smaller than the 
EWrest > 9A obtained by iHibon et al.l (j2009f ) for their 
Lya candidates at 2^=7.7. This difference arises due to 
the smaller bandwidth of our UNB filter, and our some- 
what shallower J band imaging. Deep J-band observa- 
tions will help in getting either measurements or stricter 



lower limits on the line EWs, but will also be observa- 
tionally challenging. 

8. SUMMARY AND CONCLUSIONS 

We have performed a deep, wide field search for z =7.7 
Lya emitters on the NEWFIRM camera at the KPNO 
4m Mayall telescope. We used an ultra-narrowband fil- 
ter with width 9 A and central wavelength of 1.063/im, 
yielding high sensitivity to narrow emission lines. 

After careful selection of candidates by eliminating 
possible sources of contamination, we detected four 
candidate Lya emitters with line flux > 6 x 
10~^^erg s~^ cm~^ in a comoving volume of 1.4 x 
10^ Mpc^. While we have carefully selected these four 
Lya candidates, we note that the number of Lya can- 
didates is more than the expected number obtained by 
using the z=6.6 luminosity function of Kashikawa et al. 
2006, thou gi:h quite cons istent with the z=5.7 luminosity 
function of lOuchi et al.l (2008). Hence, our results would 
allow for a modest increase in the Lya LF from z = 6.5 
to z ~ 8. Spectroscopic confirmation of more than two 
candidates would show that such an increase is in fact 
required. However, more surveys are needed to account 
for the uncertainty due to cosmic variance. 

In order to use the Lya luminosity functions as a test 
of reionization, we need to be able to detect variations 
in L^^ the characteristic luminosity, of factors of three 
or four. This will require larger samples, spectroscopic 
confirmations, and a measure of field-to-field variation. 

It is therefore premature to draw any conclusions about 
reionization from the current sample. It is, however, en- 
couraging that we are able to reach the sensitivity and 
volume required to detect multiple candidates robustly. 
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